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ABSTRACT 


V 

The  Pdlya  process,  in  which  the  occurrence  of  one  event 
affects  the  time  of  occurrence  of  the  next  event,  was  studied 
as  a possible  description  of  the  clustering  found  in  submarine 
echo  structure. 

Theoretical  derivations  of  the  properties  of  the  Polya 
process  are  presented,  followed  by  experimental  results  obtained 
by  a computer  simulated  model. 

The  Polya  process  has  been  found  to  be  approximated  by  an 
ensemble  of  Poisson  processes  with  random  mean,  with  pronounced 
clustering  appearing  only  in  the  ensemble.  This  representation 
makes  it  difficult  to  employ  the  process  in  the  study  of  echo 
structures . 


INTRODUCTION 


§ 


It  was  initially  thought  that  a clustering  formation  in  echo  struc- 

/ 

ture  from  submarines  might  be  described  by  a Polya  process,  in  which  tht 
occurrence  of  one  event  affects  the  time  of  occurrence  of  the  next  event, 
(leading  to  a bunching  of  events  more  pronounced  than  clustering  due  to  a 
Poisson  process). 

/ 

The  experiments  performed,  using  computer  simulated  Polya  processes, 

show  that  the  process  is  a non-ergodic  one.  Parameter  estimation  is  thus 

very  difficult  unless  an  ensemble  of  sample  functions  is  considered.  A 
/ 

model  for  the  Polya  process  was  found  in  an  ensemble  of  Poisson  processes 
with  random  mean. 


I 


Most  significant  was  the  discovery  that  the  clustering  effect  of 
the  process  Is  an  ensemble  rather  than  sample  function  property.  Thus 
t he  process  would  be  difficult  to  employ  practically  in  this  physical 
s 1 1 uat Ion. 

The  mode l consisting  of  an  ensemble  of  Poisson  processes  is  appli 
cable  as  the  time  and  number  of  events  become  large  (usually  N > 100 
events).  However,  the  first  segment  of  any  one  sample  function,  which 
is  marked  by  pronounced  f luctuat ions  in  mean,  could  contain  useful 
information  and  is  still  under  study. 

Theoretical  derivations  of  the  various  characterist ics  of  the 
Polya  process  are  first  discussed,  followed  by  experimental  results 
obtained  through  computer  simulation.  This  paper  is  in  part  an  elabor- 
ation of  t'onollv's*  work. 

URN  MODEL 

The  Polya  process  is  most  clearly  introduced  by  considering  tiist 
the  discrete  situation  represented  hv  an  urn  model. 

From  art  urn  having  b black  and  w white  balls,  one  ball  is  drawn 
at  random.  It  is  returned  to  the  urn  with  s balls  of  the  color 
chosen.  The  probability  of  a particular  color  being  drawn  thus 
increases  each  time  that  color  is  chosen. 

The  probability  of  drawing  two  successive  black  balls  is 

b b + s 

b + w b + w + s 

1 Re te fences  are  listed  on  page  SS. 


lb 


and.  in  general,  the  probability  of  choosing,  out  of  n drawings,  n, 
black  balls,  and  na  white  balls  (where  11  = 0^  + n3)  is 


b(b  + s'...(b  + nx  - 1 s)  w(w  + s)...(w  + n8  - 1 s) 

(b  w)  (b  + w + s)...(b  + w + n - Is) 

If  one  defines  the  state  of  the  system  as  the  number  of  black 
balls  drawn  and  denotes  a system  having  k black  balls  by  E.  , then 
the  probability  of  there  being  a transition  from  state  E,  to  E. 

K Kt-  1 

at  the  (n  + l)1*'  trial  is 

b + ks  _ p + k y 
b+w+ns  1 + n y 

where 

h 

^ b + w 


- 

1 


s 

\ 3 

b + w 


Let  drawings  be  made  such  that  each  one  occurs  in  time  h where 
h = t/n  and  let  h -»  0 while  n -»  « so  that  np  -*  Xt  and  ny  •-*  a\t.  The 
factor  a can  be  considered  a "contagiousness"  factor  and  is  equal 
to  0 for  the  Poisson  process.  In  this  limit 

P + ky  _ ^ np  + kny  l Xt  + ka\t  X(1  + ka) 

l + ny  n l + ny  n 1 + aXt  1 + aXt  ' 


- — I 


3 


Letting  k = n where  n = 0,  1,  2... and  replacing  h by  At  gives 


and  0 (t)  At  expresses  the  conditional  probability  of  an  event  (in  lieu 
n 

of  drawing  a black  ball)  during  the  time  interval  At  after  n events  have 


occurred  during  time  t.“ 

Thus  the  transition  probability  in  the  Polya  process  depends  upon 
the  actual  state  of  the  system,  a situation  described  in  the  following 
two  postulates: 

1.  Direct  transition  from  a state  E is  only  permitted  to  E ; 

n n + i 

2.  The  probability  that  during  (t,t  + h)  a transition  occurs  from 

E to  E is  [ B At  + o(h)l  and  the  probability  that  more  than  one 

n n + l n 

transition  occurs  during  this  interval  is  o(h). 


CONTINUOUS  SITUATION 

In  time  (0,  t + h),  n changes  can  take  place  by  having  n changes 

occur  in  (0,t)  and  none  in(t,  t + h) , or  having  n - 1 changes  occur  in 

(0,t)  and  one  change  in  (t,  t + h).  The  probability  of  having  more  than 

one  change  in  (t , t + h)  is  o(h).  Letting  P (t)  denote  the  probability 

that  exactly  n changes  occur  during  a time  interval  of  length  t,  and 

P (t)  the  probability  that  no  changes  occur  in  this  interval,  the 
o 

following  equations  can  be  formed: 


4 


Pn(t  + h)  - P„(t)  (1  - 8„M  + Pn.,(t)  Bn_lh  + “O') 


P (t  + h)  - Pn(t) 
n u 

h 


B P (t)  + B 
n n 


n-i 


Pn-i(t)  + 


o(h) 

h 


therefore 

‘ ' BnPn(t)  + Sn-1  P,W<C> 

Po<‘>  ’ - W0 

Equation  (2)  can  be  solved  giving 

. . CONST 

Po(t)  = (l  +'  aTo  l/a 


(1) 

(2) 


Using  the  initial  condition  that  no  event  takes  place  at  time  t 0 
it  follows  that  PQ(0)  = ^ anc* 

Po(t)  * (1  + aXt 

The  solution  of  Equation  (1)  for  Pi(t)  is  then 

pi<c>  = (1X+  a"U)1+1/a 


with  the  integration  constant  chosen  so  that  P^O)  = 0.  By  induction 
it  can  be  shown  that  in  general 

5 


r„C> 


V t (1  + a)  (l  + 2a>.  ..a  . » - 1 <0 


n!  (1  + a\t) 


n+i  /a 


rho  probability  density  Pj(tx)  of  having  only  one  event  in  the 
interval  (0,0  with  time  of  occurrence  tx  is  (see  Appendix  A) 


PiOi^  - 


(1  + a\t ) 


^+1  /a 


This  density  is  uniform  and  independent  of  tx;  it  depends  only  upon 
the  total  time  being  considered.  Thus  this  event  can  occur  at  any 
random  time  tx  within  t with  uniform  probability.  In  general. 


Pit*  ,ta  . . t^) 


\ (1  + a)  (1  + 2a)... (1  + n - l a) 


(l  + a\t)n+1/a 


The  probability  of  having  n events  occur  anywhere  in  the  inter- 
val (O.t)  is  then  (see  Appendix  B) 


Pn(t)  = j dtx  j dt8...j  p(tl,ta...tn)  dtn 


o t 


Vt'  (1  + a)  (1  + 2a). ..(1  + n - 1 a) 

t /i  , ...n+l/a 

n.  (1  + a\t) 


which  has  been  found  earlier  [Equation  (5)1  as  the  solution  to 
Equation  (1). 


Consider  now  (t  x ,t3  ,. . . t^ ) , the  probability  that  n + 1 
events  occur  in  time  t , the  last  event  occurring  at  the  end  of  the 

IVrl 

interval.  Integrating  with  respect  to  tlft8,...t^  ^ over  their  ranges 
will  result  in 


dt,  I dt8.  . . I P , (t,  ,t8  ,.  . . t ) dt 

1 J 8 J n+i  1,8  n+i  n-i 


, 1 + a)  ( 1 4 2a) . . . ( 1 + na) 


(i  + a\tn+:) 


n+i  +1  a 


(n-l).' 


which  is  the  joint  probability  density  that  the  n event  will  occur  i 

the  interval  (t  ,t  + dt  ) and  the  (n  + l)1*'  in  the  interval 
n n n ' ' 

(t  + T,t  + T + dT)  despite  the  particular  times  of  occurrence  of 
n n ’ 

the  previous  events.  Integrating  with  respect  to  t over  its  range 

n 

(0  ,o»)  will  give  the  probability  density  of  T,  the  interval  between 
, th  , . t It 

the  n and  (n  + 1)  events.  Replacing  t bv  t + T and  integrating 

1 n+i  n ' 


.*  ,n+i  . x . , n-\  , 

g(T)  - , A H + •»).  -^1  + dt  « l 

Jo  (n  - n:  (l  + a\tn  + a\t)n+1+l/M  n (1  + a XT'. 1+1  'a  ^ 


which  is  independent  c>f  n. 

The  r1*'  moment  of  the  distribution  of  T is  given  by 


ur  - j fr  g(T)  dT  - J T* 


o (1  + aXr) 


l +i  / a 


X (1  - a)  ( l - 2a)... (1-  ra) 


with  the  restriction  that  1/a  > r.  Thus  the  mean  value  of  T is 


T = X(1  - a)  » 3 < 1 ’ 


and  the  variance  is 


02  ( T)  = T2-  - t 


X2(l  - a)2  (1  - 2a) 


, a < 


GENERATING  FUNCTION 

If  P (t)  is  the  probability  that  n events  occur  in  the  time  interval 
n 

(0,t)  then  the  generating  function  is 


P(x,t)  =[  x"  Pn(t) 


By  differentiating  P(x,t)  with  respect  to  t ar.d  using  differential 
Equations  (1)  and  (2)  which  define  the  Polya  process  one  obtains 


(1+  aXt)  + Xax(l  - x)  6P-^?t)  = X(x  - 1)  P(x,t) 


The  left-hand  side  represents  the  derivative  of  P(x,t)  in  the  direction 
((1  + a\t),  Xax(l  - x)).  Thus,  along  the  curve  described  by 


dx  _ Xax(l  - x) 
dt  1 + aXt  * 


P(x,t)  will  satisfy 


dP  _ _6P  _6£  dt 
dx  6x  6t  dx 


X(x  - 1)  P = JvP 
Xax(l  - x)  ax 


Solving  Equations  (15)  and  (16)  simultaneously  with  P(l,t)  = 1 will  give 


P(x,t)  = (1  + aX(l  - x)t) 


The  mean  and  variance  of  n are: 


= Xt 
x = 1 


Var(n) 


x = 1 6x 


x = 1 


V 6x  x = 1 J 


af  t3  + Xt 


Thus,  the  mean  number  of  events,  for  an  ensemble  average,  in  the 
time  interval  t is  X,  which  also  is  the  mean  for  the  Poisson  process 
having  intensity  X.  However,  the  variance  is  larger  than  that  of  the 
Poisson  process. 


A 


OOKKFUU'ION  OF  INTKKVAl.S 


At'  interesting  conclusion  is  that  the  correlation  coefficient  ol 
two  t Imo  Intervals  is  a,  if  ,1  < 

& 

I'he  correlation  coefficient  of  T,  and  T is 

1 nd 

COvfT,,  T ) K ( T T ) - K ( T ) K(T  ) 

' 1 n+i  _ ' | n-H  J‘  ' n-H 

OfT,)  OfT  ) 0(t.)0(T  ) 

I tt  + \ ' | ' n+\ 


F.ii  h t *■  t in  ttas  previously  been  found  | lupin  I i ons  fill  and  (I  ')] 

except  Fit  r > . Vltis  is  expressed  as 
I n+i 


K ( T T > ■»  I I T,  T P ( t , , T ) dr,  d T 

v | n+i  J J | nil  v 1 nfi  I 


n-H 


The  probability  density  function  pit,  , r ) of  the  two  intervals  r, 
' I tv*  i 1 


and  t is  found  from  the  probability  density  fund  ion  p(t  ,.T, ,t  ,r 
tin  linn 


that  these  intervals  follow  the  particular  times  t , and  t 

1 ti 


a a a a 

P(t..T  ,t  ,T  ) - I dt  v I dt  5 . . . 1 dt  ! " dt 

1 |n  n+i  %l  1 .1  * *>  |-v  J. 

° Vt-  ')« 


l-H*' 


P ( t « , te  ..  . . t ,t  + T I dt 

1 * n n n+i  n- i 


n-.i 


where  p(t<,ts.,,,t  ,t  * T ) is  the  uniform  density  of  Kqnat ton 


Substituting  In  each  term  greater  than  t^  the  variable 


‘ l-M  " f.l+3  " T.l  " *; 


t • t,  - T - t 
)+a  ,1+a  .1 


gives  (see  Appendix  B) 


t,1'1  o„-’, ,-a 

p<tj>  Ti>  '»«  V,'  • <W  („-■{- 


ii<t,.t3 .. ..i„,  + T,m) 


Integrating  t,  from  0 to  (t  - T.)  and  then  t from  T,  to  « yields 

1 « ,1  n .1 


p(T  , T ) 

1 U+1  (1  + a\(T  +T  ))‘1+l/a 

v | n+i 

This  result  is  Just  the  density  of  two  events  in  the  Interval 

Tj  f t1,41  liquation  (7)1  and  exemplifies  the  independence  of  t ime  (see 

Appendix  A). 

Integrating  Equation  (21)  then  gives 


'<Ti  \m>  • f < rh;>  <-rhu> 


11 


Combining  terms  gives  the  correlation 


F (rn> 


>r  <rh;><rh;>*>*'a 


a , i f a < 4 


GKNKRAT1NC  1V1.VA  PROCKSSKS 


io  generate  a Polya  process  it  is  out  van  t t 


t geo us  to  utilize  a method 


given  hv  tonollv.  It  n events  have  occurred  in  the  time  interval 
(C.t  >,  then  tlu'  conditional  probability  for  t he  tn  + 11 1 *’  evei 


■m 


occurring  in  interval  (t  ,t  + dt  ) is 

u+i  u+i  n+v 


P„a..  C 1 1 . t a . — t .. . 1 


«±i 


h ( t i , ,ta  ... . t ) 

n+i  n+i  1 lf  3 n'  p (tl  t ) 


n-t  i 


X(1  + na)  (l  + aXt  )n+l/a 


(l  + aXt  ) 

n+f 


n+l+l /; 


(• 


Hie  conditional  probability  density  of  the  + l)11’  interval  T is 


'W  '„) 


\(1  + na) ( 1 + a \t )n+1/a 


(l  + aXt  -faXl) 


n+i+i/a 


which,  when  integrated  between  0 and  T,  the  range  of  T,  becomes 


H,m  * 1 “ (s. 


I + a Xt  -.n+r  / a 
« 


l + aXt  +aXt 


The  (n  + l)1'  interval  t can  be  computed  if  (1  - Hn+1 
(I'l  1 1 > 1 g >•  • • t ))  is  replaced  by  one  of  a sequence  of  random  numbers  (R) 
uniformly  distributed  over  the  interval  0 < H < 1. 


1 + a\t 


n+ 1 / a 


l + a\t  +aXr  " J 
n n+i 


To  show  that  this  procedure  is  valid,  consider  a random  variable 
x with  a uniform  distribution  between  0 and  l.  It  is  necessary  to 
find  a transformation  function  G which  transforms  x into  another 
random  variable  t with  the  required  probability  density  pT("0  of  the 
next  interval. 

if  the  relation  t = G(x)  is  defined,  then  the  t rans format  ion 
relat tons  are 


F(t)  = x < > G(x)  = T 


The  relation  between  p and  p^  is  found  in  the  following  manner 


l’(x  x a)  * J Px(x) 


.T  = G(a)  , f.T 

I ° PK<*0»l  dr  I t,T  = J »VT> 

To  * r’(°>  To 


t he 10  fon' 


Pt(t)  « Px(x(t))| 


PT(T> 


l ilF  ( V) 
l dT 


J P T ( T ) ‘IT  " F(T)  - X 


rims,  tin'  function  that  transforms  the  random  variable  x with 

uniform  density  into  a random  variable  T with  density  Pt(t)  is  the 

inverse  of  the  distribution  function  of  that  T. 

From  Equation  ('01  a set  of  recurrent  equations  is  formed  with 

which  T can  be  venerated, 
n 


T 


1) 


T 

n+i 


l + a\t 


a 


an+i 


n+i 


with  ( » t + T . 

n n-i  n 

fhe  Polya  process  is  then  the  set  of  these  successive  time 


tut  ervals 


EXPERIMENTAL  RESULTS 


Polya  processes  were  generated  through  a computer  simulation  using 
Equations  (31)  and  (32 ) . The  first  500  events  of  each  process  were 
examined.  Several  characteristics  of  the  process  were  studied  through 
the  use  of  graphs,  and  the  results  ot  variations  ot  the  parameters 
a and  X. 

Earlier  it  was  shown  that  the  mean  value  of  an  interval  j between 

successive  events  is  r-r^ r and  the  variance  -5 — • The 

*0  - X8(1  - a)3  (l  - 2a 3 

results  ot  an  extensive  number  ot  trials  show  clearly  that  tin-  process  is 
non-ergodlc,  as  the  ensemble  means  do  not  agree  wi tli  the  sample  means. 

The  following  table  which  shows  the  means  across  several  sample  functions 
and  the  mean  ot  these  sample  means  will  clarify  this  non-ergodiei  tv. 

As  is  obvious  from  the  data,  the  theoretical  and  experimental  values 
tend  to  vary  greatly  from  each  other  as  the  factor  a reaches  .5,  ,n  cftect 
in  accordance  with  the  fact  that  the  variance  increases  with  a.  rhe 


variance  is  no  longer  a valid  measure  it  a > .5  and  the  mean  loses  its 
validity  it  a > 1,  as  theoretical lv  each  will  go  to  infinity  at  these 
re s pec  t i ve  va l uc s o f a . 


MEAN  INTERVALS:  Sample  Versus  Ensemble 


In  another  experiment  the  factor  a was  given  values  larger  than  . S 
and  1.0  so  that  either  t ho  mean  or  variance  would  theoretically  go  to 
infinity.  The  results  are  shown  in  Table  IB.  The  values  do  become  large 
however,  they  will  never  approach  infinity  due  to  the  finite  bounds  of 
the  experiment. 

From  Figures  3-7  it  can  be  seen  that  the  sample  means  approach  a 
constant  value  very  quickly,  usually  within  the  first  100  events. 

But  since  these  means  are  in  such  a large  spread  about  the  theoretical 
mean . the  parameters  a and  \ cannot  be  determined  from  a single  process. 


Means  & Variances  of  the  Interval  with 
Large  Values  for  Factor  a 

TABLK  IB 


Sample 

Mean 

S amp  1 e 
Var i ance 

Ensemble 

Mean 

Ensemble 

V a r i anc e 

Theoretical 

Mean 

Theoret ica 
V a r i ance 

14.  lb 

l*>8.  U 

10.  OS 

lOb.bl 

IS.O 

Infinity 

8.41 

b8 . 1 b 

4.88 

100. a 7 

*>.S7 

*>S.8l 

8.2  3 

70.  SO 

t.O  4/30  27. 2S  710.07 

b.  12  »p.ll 

p.bb  38.  si 

21.83  -4^7. -,2 

■47 . 27  223*1.84 


21.82 


t'4c>.  t*>  Infinity 


Int ini t \ 


APPROXIMATE  MODEL  FOR  POLYA  PROCESS 
The  probability  density  function  for  8v.  the  mean  rate  of  intensity 
as  t and  n approach  <*.  of  the  Polya  process  is  found  by  transforming  the 


probability  density  p (t). 


(1  + a\t ) 


U-M  / 


Using  tlio  substitution  t 


resul ts  in 


ttu-  Jacobian.  |(Pg(P)  -|$|p, 


»,8(S) 


\n  /Hv/nvn  . 

^ O ^ »>)...(!  + na) 


a \n 


Upon  employing  the  identity 


z l 
n n. 


z(z  + 1>. . . (z  + n) 


'(2) 


p»<»  - a 


-e/a\ 


* 


The  mean  E(0>  is 


....  ' ^ vl /<*-!  o'^ 

E(6'"J  r\'rd  77T 

o T(-> 

a 


de 


Although  the  distribution  of  8^  is  spread  about  the  value  \ as 
evidenced  bv  Figures  1 2b  * l-*b,  the  mean  value  is  \. 

A graph  of  the  probability  distribution  of  8 for  various  values 


00 


of  a is  given  below. 


Figure  l - Ttu'  probability  distribution  for  various 

values  of  a 

As  the  factor  a approaches  0,  the  distribution  approaches  th« 
singular  value  of  X.,  characteristic  of  the  Poisson  process.  For  1 
values  of  a,  the  intensities  are  spread  about  the  mean  intensity  1 
The  mean  Interval  length  t - ^ can  be  found  by  calculat ing 


ar  get 


p (r)  using 


b t!i  the  mtan  rate  and  tin  wean  interval  length  agree  with  earlier 
t i suits. 

New  consider  an  ensemble  of  Poisson  processes,  with  intensities 

distributed  according  to  p.(8)  and  thus  having  a mean  intensity  of  \. 

Ihe  interval  lengths  are  distributed  by  p^(T)  and  the  mean  interval 

length  is  — T r* 

\i,l  - a) 

The  mean  interval  length  for  a Poisson  process  with  intensity  \ 

will  be  t ^ \. but,  although  the  mean  intensity  of  the  ensemble  of  such 

processes  is  also  \.  the  mean  interval  length  of  the  ensemble  will  be 

1 . . 1 

\ ..  ^ which  is  greater  than  — . 1'his  results  from  the  spread  of 

$ around  \ and  the  fact  that  the  inverse  of  a mean  can  be  smaller 
t ua a the  mean  of  the  inverse.  A simple  example  of  this  is 


whereas 


<i> 


us 


_L  7 

11  L 


f = .112 


1=6 


there  fore 


rims . the  polva  process  can  he  interpreted  as  an  ensemble  of 

Poisson  processes  with  intensity  distributed  bv  pQ(P)  and  interval 

P 

length  by  p_(T).  No  one  sample  function  will  reflect  the  character- 
istics of  the  Polya  process,  but  such  an  ensemble  defines  it  with 
good  approximation. 

As  mentioned  in  the  Introduction  the  Polya  process  was  initially 
studied  to  possibly  explain  the  sonar  echo  structure  of  submarines.  It 
was  initially  thought  that  this  structure  could  be  described  b\  such 
a process  rather  than  by  a Poisson  process  due  to  the  pronounced 
clustering.  This  clustering  effect  was  assumed  to  be  inherent  in  the 
process  through  the  presence  of  the  "contagiousness"  factor  a,  which, 
upon  the  occurrence  of  an  event,  would  influence  the  time  interval  to 
the  next  event.  From  the  preceding  results,  it  can  be  shown  that  this 
clustering  is  an  ensemble  rather  than  a sample  function  effect. 

The  clustering  behavior  can  be  seen  by  comparing  the  Polva  process, 

1 


an  ensemble  of  Poisson  processes  with  mean  interval  length  ^ ^ . 

and  a Poisson  process  having  the  same  mean.  One  would  expect  to  find 
a greater  number  of  short  time  intervals  in  the  Polya  process  if  it 
exhibits  clustering.  Thus,  for  some  T, 


21 


dT 


J ,,  , .1+1/a 

O (1  + a\T) 


> \(1  - a) j e-^(i-a)T  dT 
o 


i nt eg r a t i ng  g i ves 


in  (l  + a\T)  > X(1  - a)  T 


l s ing  the  ident  i tv 


in  x > 1 


x > 1 

X 


and  the  restriction  that  a < 1 as  the  mean  is  involved,  it  can  be  shown 
that  Equation  (-*1)  is  true  for 

T <_J 

\(1  - a) 

Hits  means  that  there  will  be  a greater  number  of  Polva  intervals  with 
v r ue  less  than  the  mean  than  Poisson  intervals,  if  both  processes 
luvi  the  same  mean  interval  value  r. 

Ml  - a) 

Solving  the  equation 

\(1  + a\T)‘(l+l/a)  = \(l  - a)  e“M1_a) T 


r 


shows  that  the  distributions  intersect  at  T = -r—~ A sketch  of 

\(3  - a) 

the  distribution  functions  would  appear  as 


and  Poisson  Processes  Having  the  Same  Mean  Interval. 


An  interesting  invariant  in  all  of  the  generated  processes  is  tin 

t 

product  of  and  the  mean  time  interval  — as  n and  t become  large. 
Assuming  that  n and  t approach  “ together, 


n . t » <» 


§ _il 
X ‘ n 


1 t an  \ __n 

V l + aXt  J ' n 


lint  7 I - 
X V n 


t + ant 
n n \ 


-r  + ant 
X n 


This  lias  been  verified  experimentally  and  results  appear  in  Table  2. 
1 he  characteristic  can  be  seen  by  observing  Figures  12-14. 

It  was  initially  thought  that  this  fixed  value  per  process  could 
be  used  for  parameter  estimation,  but  the  transition  probability  cannot 
be  found  for  the  sample  function  being  considered. 

Ibis  result,  however,  does  further  support  the  hypothesis  that  the 
sample  function  is  a Poisson  process  with  random  mean.  The  product 


n , t » « 


is  characteristic  of  the  Poisson 


process,  where  t?  « - — . 


Correlation  Coefficient  for  Processes 
with  Various  Values  of  the  Factor  a 


> 


TABLE  * 


a 

A 

Correlation  Coefficient  of  t t 

i in 

. i 

4/30 

. 036b 

4/30 

. 147 

. j 

4/30 

. 348 

« \ 

4/30 

.2b 

. 5 

4/30 

.38 

. b 

4/30 

.408 

. 7 

4/30 

.56 

.8 

4/30 

. 5b 

. 4 

4/30 

. b8b 

l .0 

4/30 

. 804 

The  numerical  estimation  does  not  approach  the  factor  a,  even 
below  tiie  restriction  a <.5,  although  such  a large  number  of  sample 
points  were  used. 


CONCLOS IONS 

Although  various  methods  were  employed  in  an  attempt  to  illuminate 
the  problem  of  parameter  estimation,  the  non-ergodicity  of  the  process 
and  the  discrepancy  between  theory  and  experiment  in  the  evaluation  of 
the  correlation  coefficient  make  this  extremely  difficult. 

Each  process  becomes  stable  as  n and  t become  large  and  can  be 
interpreted  as  a Poisson  process  with  random  mean.  The  Polva  process 
can  thus  be  seen  as  an  ensemble  of  Poisson  processes  with  clustering 
occurring  only  as  an  ensemble  characteristic. 


2 b 


Due  to  its  fluctuating  nature,  the  first  segment  of  each  sample 


J 


function  might  contain  information  on  clustering  tendencies  in  the 
sample  function.  It  is  being  studied. 
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APPENDIX  A 

First  consider  the  possible  situation  of  having  no  events  occur  in 
the  interval  (.0,0.  If  a division  is  made  into  subintervals  such  that 
6t  - — . then  the  probability  that  no  event  occurs  in  titer*'1  interval 


1 - |^(t  ) St  = 1 - 


= 1 


\6t 


I + a \t 


s 


1 + ra\— 


1 - 


- 1 - 


X5t 


I + a \r  6t 


\t 


+ raXt 


If  every  subinterval  is  to  he  empty,  this  probability  would  b 


p (t)  = n vi  - Xt 


o'  7 r‘^  \ s + ra\t  - 

It  was  found  in  Equation  (1)  that  the  probability  of  having  0 events 
in  the  time  t is 


P,(t) 


l 


(l  + a\t) 


t /a 


there  fore 


lint  n il 
s-»  <*>  r*i 


\t 


1 


s + ra\t 


(1  + aXt) 


l /a 


4.1 


(A1 


t A ' ' 


t." 


a n 


tA*l 


which  is  the  probability  tot 


in  empty  interval  t in  the  Poisson  process 


I i gore  A 


at  time  t,  (Figure  A),  t lie  probability  would  be 


l+>iX(t1+  r6t1 


Considering  onlv  the  last  product  series 


1 


V 


l) 


1 + aXtx 


l+a 


(A7) 


Equation  (A7)  follows  from  Equation  (An)  because  of  the  identity  in 
Equation  (A4). 

Using  this  result  in  the  preceding  probability  expression  [Equation 
tA^l  gives 


p(tx) 5t 


1 

(1  + aXtj)1  /a 


\ 

' 1 + a\t  j 


(1  + .Xtl)l+l/a 

(1  + a\t)1+l/a 


_ X 

(1  + aXt)1+l/a 

which  is  uniform  and  independent  of  tx.  Extending  this  to  the  general 
case  where  n events  occur  at  times  tlft8...t  gives 


Xn(l  + 


a)(l  + 2a)...  ( 


TTa) 


1 + n 


APPENDIX  B 


INTEGRALS  OVER  A HYPERPYRAMID 
by  Theo  Kooij 


INTRODUCTION 

Certain  calculations  of  probability  density  functions  of  Poisson 
and  Polva  processes  lead  to  the  following  type  of  integrals 


f>T  ,T  „T  ,,T 

xn  = J dTl  J dT*  J dT3---J  dTn  f(T1,T8,...Tn) 

O Ti  Tq 


n-i 


where 


0 < T,  C t2  < . . . C T < T. 

n 

The  compound  inequality  for  the  T is  the  result  of  the  occurrence  of 
sequential  events,  or  of  discrete  arrival  times,  in  Poisson  type 
processes.  Clearly,  event  number  n must  occur  before  event  n + 1, 
and  so  on. 

It  appears  that  a number  of  manipulations  with  the  boundaries  and 
the  order  of  integration  can  be  done,  sometimes  leading  to  forms  of 
1^  that  can  be  integrated  more  easily  or  more  elegantly.  Some  of 
these  manipulations  and  their  corresponding  considerations  will  be 
dealt  with  here,  often  in  heurestical  ways  rather  than  in  strict 
mathematical  terms. 
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THE  HYPERPYRAMID 


To  focus  our  thoughts,  let  us  first  consider  the  cases  I2  and  I3 
for  two  and  three  dimensions.  Instead  of  using  , t2 , t3,  let  us 
use  the  more  familiar  variables  x,  y,  and  z.  The  integral  for  two  dimen 
sions  is  then 


Since  y > x,  the  area  of  integration  in  the  X-Y  plane  is  the  triangle 
above  the  line  y = x,  bounded  by  the  horizontal  line  y = T.  See 
Figure  1. 


If  we  let  the  area  become  a volume  element  by  adding  a third 
dimension,  we  obtain 

rT  ,T  ,T 

I3  = I dx  I dy  J dz  f(x,y,z) 
x=o  y=x  z=y 

The  projection  of  this  integration  volume  on  the  X-Y  plane  is  the 
same  as  the  shaded  area  in  Figure  1,  since  the  part  containing  x and  y 
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is  the  same.  The  volume  must  therefore  lie  in  the  vertical  prism  with 
a cross  section  as  the  shaded  area  in  Figure  1.  However,  the  third 
integration  interval  ranges  over  values  of  z larger  than  y,  so  we  have 
to  consider  another  horizontal  prism.  Or  we  might  imagine  a plane  at 
45  degrees  with  the  horizontal  X-Y  plane  and  with  the  vertical  Y-Z  plane, 
and  consider  only  the  volume  above  this  plane.  The  boundaries  thus 
enclose  the  pyramid  of  Figure  2. 


Note  that  the  pyramid  contains  the  main  diagonal  (T.T.T)  as  a rib,  and 
lies  next  to  the  axis  corresponding  to  the  last  variable  in  the  sequence 
0 < x < y < z.  Cutting  the  remaining  part  of  the  prism  once  more  with 
a plane  through  the  Y-axis  results  in  two  more  pyramids,  congruent  with 
the  first  one.  See  Figure  3.  The  volume  of  each  pyramid  is  therefore 
1/3  of  the  prism,  or  1/3  • 1/2  of  the  total  cube  volume  T3 . 

Topologically  it  can  be  shown  that,  by  adding  another  dimension, 
the  three-dimensional  top  pyramid  of  Figure  2 can  be  divided  into 
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four  congruent  four-dimensional  pyramids,  all  containing  the  main 

T4 

diagonal  (T,T,T,T)  as  a rib.  The  volume  of  each  pyramid  is  thus  — . 

In  general,  the  n-dimensional  integration  volume  0 < Tj  < t3  <. . . 
< t < T is  the  hyperpvramid  adjoining  the  T^-axis.  Its  volume  is 
equal  to 


.T  .T 

Vn  = j dTi  J dT*  J dT=> 

O Tj  Ta 


,.T 


T 

n-i 


dT 

n 


CHANGES  IN  THE  ORDER  OF  INTEGRATION 
With  the  picture  of  the  pyramid  in  mind,  let  us  consider  a change 
in  the  order  of  integration  over  this  volume.  In  the  two-dimensional 
case  I2 , the  integration  over  the  shaded  area  of  Figure  1 is  first 
performed  over  y(x  < y < T) , and  this  result  of  the  integration  over 
the  vertical  lines  is  thereafter  integrated  horizontally  over 
x(0  < x < T).  It  follows  that  alternatively  we  can  integrate  first 
horizontally  over  x(y  < x < T) , and  then  integrate  the  result  of  this 
line  integral  vertically  over  y(0  < t <T).  Therefore, 


T r*T  T 

j dx  j dy  f(x,y)  = J dy  j dx  f(x,y) 
ox  o y 


A similar  procedure  can  be  followed  in  the  three-dimensional  case 


„T  -T  pT 

I3  = J dX  J dy  J dZ  f<X>y’Z) 

o x y 


* ' 

tj 
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The  last  two  integrals,  over  v and  z,  constitute  the  integrand  for 
the  integral  over  x,  and  are, therefore , equal  to  the  contribution  of  the 


function  f(x,y,z)  integrated  over  the  triangular  area  that  is  obtained 
by  intersecting  the  pyramid  of  Figure  2 with  the  plane  x = constant.  See 


This  integral  over  the  triangular  area  can  again  be  written  in  two 
different  ways 


•T  pT  »T 

X = l dy  dz  f(x,y,z)  = ! dz  dy  f(x,t,z) 

>'*  x ’ y ' Jx 

Similarly,  we  can  first  integrate  over  triangles  obtained  by 
intersecting  the  pvramid  with  planes  parallel  to  the  X-Y  plane,  followed 
by  a final  integration  over  z.  An  example  of  the  projection  of  a tri- 
angular area  on  the  X-Y  plane  is  given  in  Figure  5.  We  find 


Xxv  = J dx  j dy  f(x>y>z>  = J dy  J dx  f(x,y,z) 
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Kinallv,  l>V  I lit  ograt  1 llg  I t I ;i  I OVOI  pianos  pat.lllol  to  tin-  K-.'  piano, 


Noli'  tli.it  licii'  tlii'  t wo  I lit  ogra  I honmlarlos  ilo  not  ohango  whon  t lir  onloi 

ol  t tit  rm.lt  Ion  In  ohangml , In  so oot  ilano o with  t ho  laot  (lull  t ho 

honmlarlos  .no  I inlopoiulont  ot  I In1  int  ogi.it  Ion  vatlahlos. 

Wo  rin.l  thus  o - I.'  wavs  ot  writing  ovoi  t ho  thtoo-illuvonsloual 

pvi  aiulil.  llonoral  I v thoro  .n  o n.1  w.-ivs  to  osimons  1 . somo  ol  whlolt  ilo 

n 

not  (nviilvo  ohangos  in  t ho  hontuhiri  os  .is  was  shown  ahovo. 

It  is  I nst  rnot  I vo  to  plot  t ho  solutions  as  linos  oonnoot  ing  points 
roprosont I ng  all  tin'  intogratlon  variahlos  ami  I ho  two  honml.nl  os.  Soo 
Kignio  / loi  t ho  t hi'oo-tl  imons  Iona  I oaso. 
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Tlu>  arches  between  tho  points  represent  the  Integral  invervals.  Note 
the  following  conditions  on  tho  construction  of  each  of  tho  diagrams: 

(i)  Tho  total  number  of  arches  equals  tho  number  of  integration 
variables. 

Oil  Tho  arches  may  not  out  each  other  (but  two  ot  more  mav  mot  go 
at  one  point  1, 

t i t i 1 Kvorv  variable  must  1 i e undo  r (not  bo  part  oil  its  correspond 
ing  arch.  Generalization  to  tho  n-dimonsional  case  ts  obvious. 

From  the  diagrams  (el  and  (tl  in  Figure  7 it  becomes  now  direct t\ 
clear  that  the  corresponding  integrals  are  effect ivelv  equal.  The  two 
most  often  used  forms  of  1 are  the  types  (a)  and  (d).  ibis  gives 

.T  ,T  T ,T 

ln  " J ‘,T^  J ‘,T’  J ‘,Ta  J ‘,Tn 

O T,  T0  T 

1 * n-\ 

,,T  ,,T  . T .To 

- dr  ”d r I ''_1  dT  ...  1 dr. 

J u J n-i  J n-y  J 1 

o o o o 

The  integrals  occur  whenever  variables  are  integrated  out  in  a 

mul t i-variat e probability  densitv  function  of  a sequence  of  arrival  times. 

p (T..T-....T  >.  with  0 < T.  <Ta  <.,.  <T  *s  T . 
n 1 " n 1 8 tt-i  n 

It  is  then  possible  to  derive  probabilitv  densitv  functions  ot  lovvet 
dimensionality,  e.g.  , 

p<T»»T„>  * J ” ,,T9  J ’’  ‘,T*  •••  J " dVt  «VT*,T>---V 
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